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established the Department of Education Reform in 2005. The department’s mission is 
to advance education and economic development by focusing on the improvement of 
academic achievement in elementary and secondary schools. It conducts research and 
demonstration projects in five primary areas of reform: teacher quality, leadership, policy, 
accountability, and school choice. 

The School Choice Demonstration Project (SCDP), based within the Department of 
Education Reform, is an education research center devoted to the non-partisan study 
of the effects of school choice policy and is staffed by leading school choice researchers 
and scholars. Led by Dr. Patrick J. Wolf, Professor of Education Reform and Endowed 
21st Century Chair in School Choice, SCDP’s national team of researchers, institutional 
research partners and staff are devoted to the rigorous evaluation of school choice 
programs and other school improvement efforts across the country. The SCDP is 
committed to raising and advancing the public’s understanding of the strengths and 
limitations of school choice policies and programs by conducting comprehensive research 
on what happens to students, families, schools and communities when more parents are 
allowed to choose their child’s school. 
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Executive Summary 



As of the 2006-2007 school year, 19,733 students attended charter 
schools in the District of Columbia, representing over a quarter of the 
District’s total public school student population and one of the largest 
charter school markets in the country. 1 It is under such circumstances, 
some suggest, that choice will spur competition, ultimately leading to 
the improvement of public education. Yet, surprisingly little research 
has evaluated the behavioral response of public schools in D.C. to this 
source of competition. Most research to date on school choice in D.C. 
and elsewhere focuses on the largely positive “participant effects” 
that school choice programs have on choosers. By looking at the issue 
from the ground level of one of the most choice-prevalent districts in 
the United States, we seek to closely examine the causal dynamics of 
“systemic effects” induced by competition from within the D.C. education 
establishment. Our study consists of a series of interviews, focus groups, 
and surveys along three levels: District elites, principals, and teachers. 

Our research suggests a disconnect between the priorities of the 
educational elites and the dilemmas haunting principals and teachers 
in public schools. For years, continuous turnover in District leadership 
and persistent financial troubles captured the attention of most of the 
D.C. education sector. As such, it is unsurprising that our discussions 
with elites focused more on these issues than on responding to charter 
school competition. Though few interviewees mentioned charter school 
competition directly when asked to list the major issues in DCPS over 
the previous few years, the majority cited declining enrollment or the 



1 National Center for Education Statistics. Common Core of Data. 
http://nces.ed.gov/ccd/ 
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need to consolidate facilities as the most pressing problems facing the 
District, issues intrinsically linked to the presence of charters. Although 
education experts acknowledged that DCPS needed to improve in the 
wake of charter school competition in addition to facility right-sizing, 
their general sentiment suggested that such a behavioral response 
hinges on the motivation of individual schools, not the District as 
a whole. 

Unlike elites, most principals did not initially cite declining 
enrollment as a chief concern, but many were highly aware of the long- 
term threat of school closure by the District. While acknowledging this 
threat, most principals felt disempowered to make the changes that 
they deemed necessary to reverse negative enrollment trends. Their 
overarching concern was a lack of autonomy to hire and fire teachers, 
obtain supplies, and maintain their facilities. Principals linked the 
source of their frustration to the bureaucracy of the administration and, 
in the case of staffing decisions, the limitations brought about by the 
District’s teacher’s union contract. Without the capacity to implement 
systemic change, many principals instead focused on recruitment 
efforts as the next best alternative. Some cited the use of common 
recruiting tools such as e-mail, flyers, open houses, newsletters, radio 
ads, newspaper ads, church meetings, and other methods of advertising. 
In addition to recruiting, principals also mentioned offering “extras,” 
such as pre-K and International Baccalaureate (IB) programs, school 
uniforms, and adult classes in parenting and English to attract and 
retain new students. 

Like principals, teachers expressed an understanding of the need to 
maintain a good image in order to boost student enrollment, yet they did 
not feel compelled to change their behavior in the classroom as a result 
of competition. Specifically, when asked how district-wide changes 
affected their instruction, they routinely replied that they had not 
changed their approaches to teaching and many reported that they “put 
on a show” when being observed to ensure that they appear to be doing 
what their principals and the district tell them to do. Thus, according 
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to our sample, it appears that most of the changes that schools are making 
in order to attract more students have more to do with services for parents 
and the image of the school than with improving the educational attainment 
of students. 

Our investigation suggests that market forces that might otherwise 
be expected to spur a competitive response to school choice in D.C. are 
watered down by a lack of commitment to a truly competitive model that 
incorporates non-trivial consequences for failure. Efforts to enforce such 
a competitive model are hampered by political dynamics and burdensome 
regulations. District leaders preoccupied with politics, leadership problems, 
and administrative headaches have left individual schools to respond to 
charter school competition on their own. Meanwhile, D.C. principals are 
not responding to competition from charter schools in the ways that elites 
expected because they do not have the appropriate autonomy and resources to 
do so. Furthermore, our study suggests that the schools most affected by the 
exodus of students to charter schools continue to be mired with dysfunction. 

While most people realize that something is not working in the public 
school system in D.C., the response from all parties appears to be muted. One 
might liken this situation to a watchdog that neglects to bark upon witnessing 
a disturbance in its home. Playing on this analogy, our research suggests that 
the bureaucracy endemic to the D.C. public school system serves as a muzzle 
to prevent the dog from barking. Before the dog can bark, the District must 
find a way to remove the muzzle. 

Recent actions of Mayor Fenty and his staff, however, including school 
closings, changes in funding schemes, and staff changes, indicate that the 
competitive mechanisms of school choice might be enforced more strictly in 
the future. If these recent plans come to fruition and spark further reforms in 
line with school choice theory, further examination of the behavioral response 
to charter school competition will be required to determine the extent to which 
public schools react to competition. As Fenty and his staff take their first 
steps, many residents of D.C. hope that the muzzled dog that has yet to bark 
might begin to growl. 
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The Muzzled Dog That Didn’t Bark: 

Charters and the Behavioral Response of D.C. Public Schools 



Much of the debate over school choice has been framed by proponents who argue that choice 
will spur competition, ultimately leading to the improvement of public education. Although a 
significant body of research is emerging regarding the largely positive “participant effects” that 
school choice programs have had on choosers, precious little research exists on the “systemic 
effects” of choice programs on entire public school systems and communities. While some 
school choice studies have greatly contributed to our understanding of systemic effects, they 
have mostly been large-scale econometric exercises that measure responses from a valuable, yet 
distanced, vantage point. These studies have focused mainly on the relationship between the 
presence of school choice competition and student achievement in both choice and traditional 
public schools. While analyzing achievement through test scores is useful, such findings are 
limited in that they tell us very little about the forces that may drive public schools to respond 
to competition. 

In light of those limitations, this study is another useful contribution to a small but important 
set of studies examining the inner-workings of systemic effects of competition . 1 By looking at 
the issue from the ground level of one of the most choice-prevalent districts in the United States, 



1 Studies of other urban district responses to school choice competition to date include: John Bohte, Kenneth 
J. Meier, Robert D. Wrinkle, and J. L. Polinard. 2003. Examining the Impact of Charter Schools on Public 
School Performance. Paper presented at the National Meeting of the Midwest Political Science Association, 
Chicago, April 3-6, 2003; Frederick Hess. 2002. Revolution at the Margins: The Impact of Competition on Urban 
School Systems. Washington D.C.: Brookings Institution Press; Teske, Paul, Mark Schneider, Jack Buckley and 
Sara Clark. 2000. Does Charter School Competition Improve Traditional Public Schools? Civic Report 10 
(June), Manhattan Institute for Policy Research; Frederick Hess, Robert Maranto, and Scott Milliman. 2001. 
Small Districts in Big Trouble: How Four Arizona School Systems Responded to Charter Competition. Teachers 
College Record 103 (6): 1 1 02-1 1 24; Frederick M. Hess and Patrick J. McGuinn. 2002. Muffled by the Din: The 
Competitive Noneffects of the Cleveland Voucher Program. Teachers College Record 104 (4) 2002: 727-764; 

Eric Rofes. 1 998. How Are School Districts Responding to Charter Laws and Charter Schools? A Study of Eight 
States and the District of Columbia. Berkeley, CA: Policy Analysis for California Education. 
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the District of Columbia, we seek to closely examine the causal dynamics of systemic effects 
from within the D.C. education establishment. Our study consists of a series of interviews, 
focus groups, and surveys along three levels: District elites, principals, and teachers. A better 
understanding of the viewpoints, reactions, and relationships within these three groups, 
and their effect on the behavior of public schools in light of school choice competition, will 
illuminate the findings of previous research on participant effects and student performance 
measures. Knowledge as to how competition instigates public schools to respond, how that 
response is perceived at different levels within the system, and why schools fail to respond will 
assist in the design of future policies by providing insight into the specific mechanisms of a 
system that has embraced choice. 



What do past studies suggest about the way the introduction 
of choice impacts behavior? 

There are two dominant lenses through which to investigate the impact of school choice 
competition: impacts on student achievement and changes in organizational behavior. Several 
recent studies of the competitive effects of school choice focus on the effect of charter schools 
or private schools on public school student achievement. A review of twenty-five major studies 
of competitive effects conducted between 1972 and 2002 concluded that approximately one- 
third of the research documented a positive relationship between the level of competition and 
student achievement gains, with the majority of the studies showing no statistically significant 
relationship between the two. 2 For example, Greene and Winters found that public schools in 
Florida whose students were eligible for vouchers made gains that were 5.1 percentile points 
greater on math tests than schools not forced to compete for their students. 3 Other studies 
of Florida’s schools by Chakrabarti, Figlio and Rouse, and West and Peterson have had similar 



2 Clive R. Belfield and Henry M. Levin. 2002. The Effects of Competition on Educational Outcomes: A Review 
of U.S. Evidence. Occasional Paper 35, New York: National Center for the Study of Privatization in Education, 
Teachers College, Columbia University. 

3 Jay P. Greene and Marcus A. Winters, "Competition Passes the Test," Education Next, Summer 2004. 



Sullivan - Campbell - Kisida 



University of Arkansas - School Choice Demonstration Project 



The Muzzled Dog That Didn't Bark: Charters and the Behavioral Response of D.C. Public Schools 



April 2008 



findings. 4 In Wisconsin, Hoxby found that schools in Milwaukee that were most exposed to 
voucher competition increased math scores by 7.1 percentile points between 1999 and 2000 
compared to 3.7 percentile points for schools not exposed to the challenge. 5 Additionally, 
studies conducted by Kevin Booker et al. (2005), John Bohte (2004), G.M. Holmes et al. (2003), Jay 
Greene and Greg Forster (2002), and Caroline Hoxby (2001), found positive impacts of charter 
schools on traditional public school student achievement. 6 While proponents of choice champion 
such results, not every situation in which competitive effects are anticipated has yielded 
positive findings. In an evaluation of the effect of charter school competition on public school 
student achievement in Michigan, Bettinger found no statistically significant gains. 7 Buddin and 
Zimmer came to a similar conclusion after studying charter school competition in California. 8 
Furthermore, a few studies have even found negative effects: Carr and Ritter concluded that 
charter school competition produced small, but significant negative effects on traditional public 



4 Martin West and Paul Peterson, "The Efficacy of Choice Threats Within School Accountability Systems," Harvard 
PEPG Working Paper 05-01 , March 23, 2005, http://www.ksg.harvard.edu/pepg/PDF/Papers/West_Peterson_ 
ChoiceThreats.pdf; Rajashri Chakrabarti, "Impact of Voucher Design on Public School Performance: Evidence 
from Florida and Milwaukee Voucher Programs," http://www.people.fas.harvard.edu/~rchakrab/Papers/ 
FI-Mil_Chakrabarti.pdf; David N. Figlio and Cecilia Elena Rouse, "Do Accountability and Voucher Threats 
Improve Low-Performing Schools?" NBER Working Paper No. 11597, http://www.ers.princeton.edu/ 
workingpapers/1 4ers.pdf 

5 Caroline Minter Hoxby, "The Rising T\de" Education Next, Winter 2001. 

6 K. Booker, S. Gilpatric,T. Gronberg, & D. Jansen. 2005. The Effect of Charter Schools on Traditional Public 
School Students in Texas: Are Children Who Stay Behind Left Behind? National Center for the Study of 
Privatization in Education, Teachers College, Columbia University; John Bohte. 2004. Examining the Impact of 
Charter Schools on Performance in Traditional Public Schools. Policy Studies Journal, 32(4), 501-520; 

G. M. Holmes, J. DeSimone, & N. G. Rupp. 2003. Does School Choice Increase School Quality? National Bureau 
of Economic Research Working Paper Series, 9863; J. P. Greene & G. Forster. 2002. Rising to the Challenge: 

The Effect of School Choice on Public Schools in Milwaukee and San Antonio. Civic Bulletin 27 (October), 
Manhattan Institute for Policy Research; C. M. Hoxby. 2001 . How School Choice Affects the Achievement of 
Public School Students. Hoover Institution, KoretTask Force. 

7 Eric Bettinger. 1999. The Effect of Charter Schools on Charter Students and Public Schools. NewYork: 
National Center for Study of Privatization in Education, Teachers College, Columbia University. 

8 Richard Buddin, & Ron Zimmer. 2005. Is Charter School Competition in California Improving the 
Performance of Traditional Public Schools? RAND Working Paper. 
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